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ABSTRACT 



This case study examined the role of field dependence in the 
failure of an online dyadic discussion of a complex issue, whether or not 
creationism should be placed on an equal footing with evolution in high 
school science classrooms. In this study, field is used to designate whole 
disciplines, rather than factions within disciplines. Using discourse 
analysis methods developed by J. Gee (1999) , the study shows how each 
individual approaches the given issue from her own field, contributing to the 
failure of the negotiation. A transcript of an online discussion between two 
participants in a secondary education course, one an anthropologist by prior 
training and the other a chemist, was analyzed. Analysis of the discussion 
shows two opposing situated social activities, establishing interpersonal 
subjectivity versus intellectual one-upmanship and knowledge display. These 
social activities shape the arguments each participant constructs. The paper 
also discusses the limits of field dependence as an explanatory mechanism in 
this instance and expands the notion that social argumentation is not just 
field dependent, but also socially situated. The argument an individual 
produces is not just an outcome of the field of knowledge that the individual 
makes relevant, but also of the socially situated activity it reflects and 
helps constitute. An appendix contains a transcription of the discussion. 
(Contains 26 references.) (SLD) 
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Complex issues, by nature, can reasonably be considered from a range of different 
vantage points that crosses disciplinary lines, yet, as Toulmin (1958) points out, "the 
criteria or sorts of ground required to justify... a conclusion vary from field to field" (p. 
36). Therefore the standards by which we measure the quality of someone's argument 
about such issues should vary depending on the discipline or field that individual — to 
borrow a phrase from Raymond Carver (1988) — is calling from. 

For example, consider the issue of whether creationism should be taught on an 
equal footing with evolution in the high school science classroom, an issue recently 
contested and highly publicized after the Kansas State Board of Education's removal 
(Belluck, 1999) and subsequent reinstatement (Fountain, 2001) of evolution from the 
state's science curriculum. Is this an ethical issue about equal representation? A 
political issue about the type of education that best resonates with a democratic system? 
A scientific issue about which theory the preponderance of evidence supports? Or a 
philosophical issue about what constitutes science itself? 

This topic lies at the intersection of all these fields — ethics, political science, 
science (i.e. biology), and philosophy — and, as such, can be reasonably debated from 
the perspective of each. Thus, there is a range of argumentation strategies I might use 
to justify my position on the issue that is contingent on the way in which I construe the 
issue and the relevant domain. If I construe the issue, for example, as a scientific one, 
then the extent to which I compare the empirical evidence supporting each theory 
would be one obvious criterion by which the strength of my argument might be judged. 
If, on the other hand, I consider it an ethical question, then such evidence is simply 
beside the point. 

Individuals faced with the task of constructing an argument about a complex 
issue can, and will, provide reasonable arguments that vary depending on the manner 
in which they construe the issues at stake. Studies of argumentation that assume that 
argumentation is domain general (e.g., Kuhn 1991, 1992; Kuhn, Shaw & Felton, 1997), or 
(albeit implicitly) that scientific argumentation is the ideal model, fail to acknowledge 
the validity and structure of arguments from other domains. If we are to engage 
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individuals in argumentation about complex issues and hope to accurately assess their 
skill in doing so, the analytic scheme we use must be able to account for the wide array 
of feasible arguments from varying perspectives that participants can (and will) adopt. 

The field dependence of argumentation, then, has direct import for research 
practice in the field of argumentative assessment, but what about its import on the 
social practice of argumentation in everyday life? How does the field dependent nature 
of argumentation play out between individuals engaged in social debate of an issue 
whose complexity makes relevant a wide range of disciplines or fields? This case study 
examines the role of field dependence in the failure of an online dyadic discussion of the 
complex issue used in the example above (i.e., whether or not creationism should be 
placed on an equal footing with evolution in high school science classrooms). Using 
discourse analysis methods developed by Gee (1999), I show how each individual 
approaches the given issue from her own particular field, thereby contributing to the 
failure of the negotiation. I then discuss the limits of "field dependence" as an 
explanatory mechanism in this instance, and expand the notion of field dependence 
further, arguing that social argumentation is not just field dependent but also socially situated. 

The Original Experiment & Results 

The analysis described here was conducted as a post-hoc qualitative analysis of 
data collected during an experiment that compared the effects of online discussion to 
two online, individualized study techniques derived from the cognitive memory 
literature (Steinkuehler, Derry, & Levin, in submission). Following Kuhn's work, we 
gave individuals a complex issue for consideration, randomly paired them for 
discussion with a peer (in our study, using the online synchronous discussion 
environment Tapped In, www.tappedin.org), and then assessed changes in their 
argumentative ability from pretest to posttest using a coding scheme modeled after one 
by Kuhn, Shaw, and Felton (1997). This categorical scheme allowed us to ask ostensibly 
domain-general questions about the arguments individuals constructed (e.g.. Do they 
talk about the function of the issue at hand? Do they address alternatives?) as well as 
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some questions that captured some extent to which the constructed arguments were 
scientific (e.g.. Do they reference evidence?). Results indicated that, although across 
conditions participant's argumentative reasoning did improve, discussion did not foster 
greater learning gains than the two individualized conditions as expected. Given our 
surprising results, I conducted a post-hoc qualitative analysis of one of the discussion 
transcripts. 



Selection of Transcript Based on Failure 

The transcript selected for closer analysis was the 45-minute discussion of two 
participants in our original study: Emma, a former anthropology major who was for 
placing creationism on an equal footing with evolution in high school science 
classrooms, and Daisy, a former researcher in chemistry, who was against it. Both 
participants were enrolled in a secondary education course from which the original 
sample was drawn. The outcome of the pair's discussion was representative of our 
overall findings in terms of our original definition of argument improvement. From 
pre- to posttest, the pair's arguments exhibited a decrease in the proportion of non- 
justificatory statements made (statements having tittle or no argumentative force) 
coupled with an increase in both the number of references to evidence and the number 
of metacognitive statements, but showed no change in the number of statements made 
that addressed alternatives and tittle substantial decrease in the proportion of 
nonfunctional statements (statements that failed to address what the purpose or 
function of teaching creationism on an equal footing with evolution might be) or 
increase in the overall range of their arguments. Because the pair shared these 
characteristics with our overall findings, their transcript was a suitable candidate for 
further analysis. 

Final selection of Emma and Daisy's discussion transcript for closer analysis was 
based on the fact that their discussion was a failure. Rather than fostering some level of 
cognitive change or, at minimum, prompting a better articulation of their individual 
opening positions (e.g., consideration of additional alternatives), their discussion 
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appeared to elicit the opposite. From pretest to posttest, both dropped rather than 
added an acknowledgement and subsequent refutation of an argument in opposition to 
their own position; interestingly, in both cases, they were counterarguments that the 
individual's discussion partner presented during the intervening conversation. Though 
one participant, Emma, espoused a new position during the discussion, she returned to 
her original position afterwards. Neither individual exhibited actual opinion change (as 
measured by comparison of pre- and posttest opinion scales) or reported opinion 
change. Not only did both Daisy and Emma leave the discussion with the same opinion 
they walked in with, but they both actually dispensed with consideration of certain 
competing arguments, seemingly based on the fact that their discussion partner made 
and justified just those claims. In this way, their discussion yielded precisely the 
opposite effect than we had predicted. Given this surprising outcome, I conducted a 
post-hoc qualitative analysis of what transpired during their online discussion in order 
to better understand why the discussion had the negligible (and, arguably, negative) 
outcomes it had. 

Post-Hoc Discourse Analysis of an Online Discussion Transcript 

"If I had to single out a primary function of human language, it would be not one, 
but the following hvo: to scaffold the performance of social activities (whether play 
or work or both) and to scaffold human affiliation within cultures and social 
groups and institutions." (Gee, 1999, p. 1) 

The discourse analysis method used here is based on the work of Gee (1999), 
who outlines six basic aspects of "reality" that any piece of oral or written text construes 
in some way: the material world, politics (the distribution of social goods), semiotics 
(symbol systems and the forms of knowledge they entail), identities and relationships, 
activities (what is currently going on), and connections (between the present and the 
past and future). Any oral or written utterance constructs reality along these lines in 
the sense that it indicates (often implicitly) which aspects of, for example, the material 
world, are relevant and what they mean. As speakers and writers, we cue our listeners 
or readers as to which construals of "reality" are relevant (and which are not) through 
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the particular grammatical patterns or devices we recruit. These cues are essentially 
collocational patterns — "various sorts of grammatical devices [that] 'co-locate' with 
one another" (p. 29), including word choice, clausal structure, and clausal ordering (e.g., 
the backgrounding-foregrounding function of clausal transformations). 

For any analysis of language use, all six aspects of reality construction are 
relevant; however, like, most actual analyses, mine will explicitly focus on only a 
selected subset - specifically, semiotic building and activity building. The former, semiotic 
building, relates directly to the notion of "field-dependence" of argumentation, an issue I 
take up straight away; the latter, activity building, is an issue I will discuss later on. First 
things first: let me demonstrate the import of "field dependence" on the social practice 
of argumentation before arguing that it must be expanded with a richer account of 
socially situated activity itself. 

Argumentation is Field-Dependent 

Again, the primary goal of this analysis was to shed light on why Emma and 
Daisy's discussion transpired in the particular (unproductive) manner it did. Given this 
goal, the notion of semiotic building through language is particularly useful in 
highlighting the following important questions: What different symbol systems or 

forms of knowledge "count" for each participant and how do they align or conflict? 
What fields of knowledge are made relevant? Or, to paraphrase Gee (1999), what social 
groups or institutions does each participant, implicitly or explicitly, aligned herself 
with? 

Analysis of both the content and form of Emma and Daisy's contributions to the 
discussion indicates that both participants were indeed approaching the given topic 
from different disciplines or "fields." While Emma reasoned about the issue in a 
manner suggestive of an anthropologist, Daisy reasoned about the issue in a manner 
suggestive of a scientist. Two precursory disclaimers are required, however, before 
going further. First, to say that each participant seemed to take a field-dependent 
approach is not to say that either did so with expertise. Though both Emma and Daisy 




